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(54)Title: CASE-BASED REASONING SYSTEM 



(57) Abstract 

A case-based reasoning system (101) which is 
smoothly integrated into a rule-based reasoning system, 
thus coordinating case-based reasoning techniques and 
rule-based reasoning techniques in a unified automated 
reasoning system, in which an automated processor (110) 
may proceed by inferential reasoning on the facts of the 
problem and the cases by means of rule-based reasoning 
techniques or based on procedural directives supplied by 
a human programmer, and may select the case (204) 
which is the best match for the problem, but may act dif- 
ferently from the precise action prescribed for that case. A 
technique for dynamically adapting the case base (104) to 
the problems which the automated reasoning system en- 
counters, in which the processor may create additional 
cases which may exemplify the problem or which may be 
useful for future problems, or may remove cases from the 
case base which it determines from experience are poor or 
obsolete. 
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DESCRIPTION 
Case-Based Reasoning System 

Background of the Invention 

1. Field of the Invention 

This invention relates to case-based reasoning 
and to a case-based reasoning component of a rule-based 
5 reasoning system. 

2. Description of Re lated Art 

While computers are capable of tremendous processing 
power, their ability to use that processing power for 
reasoning about complex problems has so far been limited. 

10 Generally, before a computer can be used to address a 
complex problem, such as one which requires the attention 
of a human expert, it has been necessary to distill the 
knowledge of that expert into a set of inferential rules 
(a "rule base") which allow an automated processor to 

15 reason in a limited field of application. While this 
method has been effective in some cases, it has the 
natural drawback that it often requires a substantial 
amount of time and effort, by both computer software 
engineers and experts in the particular field of appli- 

20 cation, to produce a useful product. 

Moreover, rule-based systems of this type present a 
difficult programming task. Unlike more prosaic program- 
ming tasks, constructing a rule base is sometimes counter- 
intuitive, and may be beyond the ability of many applica- 

25 tion programmers. And once a rule-based system has been 
constructed based on the knowledge of a human expert, it 
may be difficult to accommodate changes in the field of 
operation in which the processor must operate. Such 
changes might comprise advances in knowledge about the 

30 application field, additional tasks which are intended for 
the processor, or changes in or discoveries about the 
scope of the application field. 
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One proposed method of the prior art is to build 
automated reasoning systems which operate by reference to 
a set of exemplar cases (a "case base"), to which the 
facts of a particular situation (the "problem") may be 
5 matched. The processor may then perform the same action 
for the problem as in the exemplar case. While this pro- 
posal has been well-received, there have been several 
obstacles to successful implementation of a case-based 
reasoning system. One obstacle has been the lack of a 
10 feature matching technique which would be successful when 
applied to a case base of reasonable size. Another 
obstacle is that case-based reasoning can be relatively 
inflexible when the case base is insufficiently rich. 

Summary of the Invention 

15 The invention provides a case-based reasoning system 

which is smoothly integrated into a rule-based reasoning 
system, thus coordinating case-based reasoning techniques 
and rule-based reasoning techniques in a unified automated 
reasoning system. In addition to matching a problem tem- 

20 plate to a case base, an automated processor may proceed 
by inferential reasoning on the facts of the problem and 
the cases by means of rule-based reasoning techniques (or 
based on procedural directives supplied by a human pro- 
grammer) . Thus, the processor may select the case which 

25 is the best match for the problem, but may act differently 
from the precise action prescribed for that case. 

The invention also provides for dynamically adapting 
the case base to the problems which the automated reason- 
ing system encounters. In addition to matching the prob- 

30 lem to the "best" case, in addition to reasoning on the 
facts of the case based on rule-based reasoning, the pro- 
cessor may create additional cases which may exemplify the 
problem or which may be useful for future problems, or it 
may remove cases from the case base which it determines 

35 from experience are poor or obsolete. An aspect of the 
invention also includes a technique in which the processor 
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may be set to work with a limited case base, and may soli- 
cit human advice for treatment of new problems which are 
not already well-treated by the case base. Thus, the 
processor may "learn" how to the do its job on a dynamic 
5 basis. 

Brief Description of the Drawings 

Figure 1 shows a block diagram of a unified automated 
reasoning system which incorporates a case-based reasoning 
system . 

Figure 2 shows a flow diagram for case-based 
reasoning. 

Figure 3A shows a data flow diagram of a first 
feature-matching technique for matching a problem to one 
or more cases in a case base. Figure 3B shows a data flow 
diagram of a second such feature-matching technique. 

Figure 4A shows a method for matching attribute- 
value pairs which have numeric values. Figure 4B shows a 
method for matching attribute-value pairs which have text 
string values. 

Figure 5 shows a block diagram of a case-based rea- 
soning system implemented within a rule-based reasoning 
system. 

Figure 6 shows an example case-based reasoning system 
for providing user help on call-in complaints. Figures 
6A-6E show example display panels in detail. 

Description of the Preferred Embodiment 

Figure 1 shows a block diagram of a unified automated 
reasoning system which incorporates a case-based reasoning 
system. 

30 A case-based reasoning system 101 for a particular 

application field may comprise a rule base 102 of infer- 
ential rules 103 suited to that field, a case base 104 of 
exemplar cases 105 which are notable in that field, and a 
data base 106 of relevant problem data 107 for that field. 

35 In a preferred embodiment, the data base 106 may comprise 



15 



20 
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a set of data records 108 stored in a secondary memory 
109. For example, in a case-based reasoning system 101 
for loan approval, the rule base 102 may comprise infer- 
ential rules 103 about the creditworthiness of the cus- 
5 tomer, the case base 104 may comprise exemplar cases. 105 
which are known to match common fact scenarios, and the 
data base 106 may comprise relevant problem data 107 such 
as loan payment histories, results of loan-officer inter- 
views and credit-check data. In a preferred embodiment, 

10 the case base 104, rule base 102, and data base 106 may be 
stored in a computer memory. 

An automated processor 110 may execute a software 
inference engine 111 for reasoning using the case base 104 
and rule base 102. In a preferred embodiment, the infer- 

15 ence engine 111 may comprise a software environment having 
a set of manipulable software objects 112, a set of soft- 
ware tools 113 for manipulating those software objects 
112, for maintaining a mapping 114 between the data 
records 108 of the data base 106 and a set of representa- 

20 tive objects 115 representing those data records 108, and 
a software language 116 for defining software objects 112 
and invoking tools. 113. The language 116 may also com- 
prise software structures for defining and altering rules 
103 (e.g., in the rule base 102) and cases 105 (e.g., in 

25 the case base 104) and, in a preferred embodiment, for 
defining and altering programming language procedural 
structures 117 such as software • subroutines . 

In a preferred embodiment, the inference engine 111 
may execute a flow diagram for case-based reasoning like 

30 that disclosed with figure 2. The inference engine 111 
may also execute a flow diagram for rule-based reasoning 
like those which are well known in the art, including 
known aspects of rule-based reasoning such as attribute 
inheritance, hypothetical reasoning, and retraction. A 

35 more detailed description of a flow diagram which an 
inference engine 111 may follow for rule-based reasoning, 
and of rule-based reasoning systems, may be found in 
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"ART-IM Reference Manual", available from Inference Cor- 
poration of El Segundo, California, and hereby incorpor- 
ated by reference as if fully set forth herein. 

In a preferred embodiment, the processor 110 may also 
5 comprise a user interface 118, to interact with a human 
operator or user 119. The user interface 118 may comprise 
an interactive terminal at which the user 119 may enter 
commands or data and at which the processor 110 may pres- 
ent information or questions to the user 119. In a pre- 

10 f erred embodiment, the user interface 118 may be used 
either for development of cases 105, rules 103, or proce- 
dural structures 117 for use in the application field, or 
for use by the end user 119 in the application field, but 
it may be preferred for some application fields to provide 

15 one user interface 118 for development and a different 
user interface 118 for use by the end user 119. 

In a preferred embodiment, the automated processor 
110 may comprise a system having a processor, memory com- 
prising a stored program, memory comprising data, and 

20 input/ output devices, as is well known in the art. The 
operation and software structures of this system are 
described herein in terms of their functions and at a 
level of detail which would be clear to those of ordinary 
skill in the art. It would be clear to anyone of ordinary 

25 skill in the art, after perusal of the specification, 
drawings and claims herein, that modification and/or pro- 
gramming (using known programming techniques) of a pro- 
cessor of known design to achieve these functions would 
be a straightforward task and would not require undue 

30 experimentation. 

In a preferred embodiment, the processor 110 may 
comprise an IBM-compatible PC configured to be able to 
execute the Microsoft Windows 3.0 and DOS 3.1 software, 
and having a hard disk drive, a mouse, and a VGA display. 

35 At least a 286 processor with four megabytes of memory is 
preferred; a 386 processor with eight megabytes of memory 
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is more preferred. The Microsoft Windows 3.0 software is 
preferably executed in 386 enhanced mode. 

Figure 2 shows a flow diagram for case-based 
reasoning. 

5 In a description step 201, the inference engine 111 

retrieves a description of the facts of a particular situ- 
ation (the "problem"). In a preferred embodiment, the 
user 119 may enter data relating to the problem by means 
of the user interface 118. For example, the user 119 may 
10 complete an on-screen form, or may answer a set of ques- 
tions provided by data-gathering software in the inference 
engine 111. 

In a case-matching step 202, the inference engine 111 
attempts to match the problem to one or more cases 105 in 

15 the case base 104. In a preferred embodiment, the infer- 
ence engine 111 may use a feature-matching technique like 
that described with figures 3A and 3B. 

In a best-case step 203, the inference engine 111 
attempts to evaluate the cases 105 which were found in the 

20 case-matching step 202, and determine a "best" case 204 to 
match the problem. In a preferred embodiment, the infer- 
ence engine 111 may present a sequence of questions to the 
user 119 and retrieve answers from the user 119 about the 
problem and the cases 105 which were found. 

25 In a note-action step 205, the inference engine 111 

determines the action prescribed by the "best" case 204, 
and attempts to determine if that action is a correct 
action to perform. If so, the inference engine 111 pro- 
ceeds to a do-action step 206. Otherwise, the inference 

30 engine 111 proceeds to a new-case step 207. 

In the new-case step 207, the inference engine 111 
adds a new case 105 to the case base 104. In a preferred 
embodiment, the inference engine 111 may retrieve informa- 
tion to enter into the case base 104 from the user 119 by 

35 means of the user interface 118, including the correct 
action to perform. The inference engine 111 then proceeds 
to the do-action step 206. 
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In the do-action step 206, the inference engine 111 
performs the action that was previously determined to be 
correct. For example, the inference engine 111 may 
present the user 119 with a suggested solution to the 
5 problem. 

Figure 3A shows a data flow diagram of a first 
feature-matching technique for matching a problem to one 
or more cases 105 in the case base 104. 

Each case 105 may be manipulated as a software object 

10 112 in the inference engine 111 software environment. 
Each case 105 may comprise a set of attributes 3 01, each 
of which has a value 302. Attributes 301 and values. 302 
are typically manipulated as an attribute-value pair 303. 
In a preferred embodiment, attributes 301 may be particu- 

15 lar to the application field, and values 302 may have data 
types which vary from one attribute 301 to another. For 
example, in a case-based reasoning system 101 for loan 
approval, each case 105 might have an attribute 301 such 
as "loan amount", which would have a numeric value 302, an 

20 attribute 301 such as "approved" which would have a boo- 
lean value 302, and an attribute 301 such as "payment his- 
tory" which would have a value 302 which is a list or 
array structure. 

In a preferred embodiment, data types for attributes 
.25 301 may comprise (a) a yes/no data type, i.e., a one-bit 
boolean value, (b) a numeric data type, (c) a text string 
data type, and (d) a multiple-choice data type, i.e., a 
data type in which the value 302 must be selected from a 
predetermined set of possible values 302. 

30 Each case 105 may have one or more signature func- 

tions 304 applied to each of its attribute-value pairs 
303. Each signature function 304 may generate one or more 
signature bits 305 in a bit-string signature 306 for the 
case 105. In a preferred embodiment, two signature func- 

35 tions 304 each generate one signature bit 3 05 apiece, and 
the resultant signature bits 305 are logical-OR-ed 
together to generate the signature 306. 
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The signatures 306 for all cases 105 may be combined 
in one or more signature files 307, each of which maps a 
set of signatures 306 to a set of keys 308. The keys 308 
may be used to reference the cases 105 as manipulable 
5 software objects 112, with all of their attribute-value 
pairs 303, an action 309 prescribed for each case 105, and 
a supplemental structure 310 of software objects 112 which 
may be kept by the inference engine 111 with each case 
105. In a preferred embodiment, one signature file 307 

10 may be maintained for each case base 104. 

To match a problem 311 to the cases 105 in the case 
base 104, a case template 312 may be constructed for the 
problem 311 with attribute-value pairs 303 which corres- 
pond to notable parameters of the problem 311. The sig- 

15 nature functions 304 may be applied to the attributes 301 
(and their values 302) of the case template 312. Each 
attribute-value pair 303 for the case template 312 may 
therefore generate a set of test bits 313 to be matched 
against the signatures 306 in the signature file 307. In 

20 a preferred embodiment, each signature 306 in the signa- 
ture file 307 may be logical-AND-ed together with the test 
bits 313, and may generate a hit whenever a signature 306 
in the signature file 307 has all the test bits 313 for a 
particular attribute-value pair 303 set to logical "1". 

25 Cases 105 which are hits may be noted in a match 

table 314. The cases 105 in the match table 314 may be 
evaluated for a match quality 315, and the match quality 
315 for each case 105 may be recorded in the match table 
314. In a preferred embodiment, the inference engine 111 

30 may determine match quality 315 for each case 105 in the 
match table 314 by a weighted sum of an evaluation 316 of 
those attribute -value pairs 303 which are matched. In a 
preferred embodiment, the weights assigned to each 
attribute-value pair 303 may be predetermined and may be 

35 altered by the user 119. The evaluation 316 of matched 
attribute-value pairs 303 may be like that disclosed with 
figure 4A or 4B. 
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In a preferred embodiment, cases 105 which are hits 
may have their match quality 315 compared against a qual- 
ity threshold 317, and those cases 105 which best meet the 
quality threshold 317 may be stored in the match table 
5 314, up to the size of the match table 314. In a pre- 
ferred embodiment, the quality threshold 317 and the size 
of the match table 314 may be predetermined and may be 
altered by the user 119. 

Figure 3B shows a data flow diagram of a second 
10 feature-matching technique for matching a problem to one 
or more cases 105 in the case base 104. This feature- 
matching technique is presently preferred over the tech- 
nique disclosed with figure 3A. 

Each case 105 may have one or more hash functions 318 
15 applied to each of its attribute-value pairs 303. Each 
hash function 318 may generate one or more locations 319 
in a hash table 320 of attribute-value pairs 303. Each 
location 319 may comprise a set of pointers 321 to one or 
more cases 105 in the case base 104. 

2 0 To match the case template 312 to the cases 105 in 

the case base 104, the hash functions 318 may be applied 
to a set of attributes 301 (and their values 302) of the 
case template 312. Each attribute-value pair 303 for the 
case template 312 may therefore generate a set of loca- 
25 tions 319 in the hash table 320, and thus generate a set 
of pointers 321 to cases 105 in the case base 104. In a 
preferred embodiment, the inference engine 111 may examine 
the locations 319 in the hash table 320 to examine 
attribute-value pairs 303 further, e.g. to determine if 

3 0 there is a match or if the hash functions 318 generated 

the same location 319 by coincidence. 

In a preferred embodiment, cases 105 which are hit in 
this manner may be noted in the match table 314 and may 
have their match quality 315 determined, in like manner as 
35 disclosed with figure 3A. Attributes 301 with numeric 
values 302 or with text string values 302 may be treated 
in like manner as disclosed with figure 4A or 4B. 
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Figure 4A shows a method for matching attribute- 
value pairs 303 which have numeric values 302. 

In a preferred embodiment, attributes 301 with a 
numeric data type may match based on a set of one or more 
5 numeric ranges 401, such as a LOW range 4 01, a MEDIUM 
range 401 and a HIGH range 401. The inference engine 111 
may compare the value 302 for the attribute 301 against 
the ranges 401 which are set for that attribute 301, and 
apply an evaluation function 402 to generate the evalua- 

10 tion 316 of how well each value 302 matches each range 
401. The evaluation 316 may be compared against an evalu- 
ation threshold 403, and matching for that attribute- 
value pair 303 may proceed on the basis that the value 302 
falls within the range 401. In a preferred embodiment, 

15 the evaluation function 402, the evaluation threshold 403 
and the ranges 401 may be predetermined and may be altered 
by the user 119. 

For example, for one attribute 301 the evaluation 
function 402 may treat values 302 of about zero as LOW, 

20 about 30 as MEDIUM and about 60 as HIGH. If the value 302 
for that attribute 301 is 36, the attribute-value pair 303 
will match the HIGH range 401 with the evaluation 316 of 
0.2, will match the MEDIUM range 401 with the evaluation 
316 of 0.8, and will not match the LOW range 401. 

25 Figure 4B shows a method for matching attribute- 

value pairs 303 which have text string values 302. 

In a preferred embodiment, an attribute 301 with a 
text string value 302 may be matched by string matching, 
word matching and character matching. 

30 In string matching, the entire text string value 3 02 

is matched exactly. 

In word matching, the text string value 3 02 is broken 
up into separate words, by reference to word delimiter 
characters, as is well known in the art. A predetermined 

35 set of noise words, such as "a", "and" and "the", may also 
be removed. Synonyms for the non-noise words may also be 
used for matching, and may be determined either globally 
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or for a particular attribute 301. The non-noise words 
are each recorded as separate attribute-value pairs 303 
which may be matched exactly. For example, the text 
string "BRADLEY P. ALLEN" would match the words "BRADLEY", 
5 "P" and "ALLEN", and if "BRAD" is a synonym for "BRADLEY" , 
would also match "BRAD". 

In character matching, the words of the text string 
value 302, as determined for word matching, are broken up 
into separate trigrams (substrings of length three) . In 

10 a preferred embodiment, each word is prefixed and suffixed 
with two special initial/final characters prior to break- 
ing each word into trigrams. The trigrams are each 
recorded as separate attribute-value pairs 303 which may 
be matched exactly. For example, the text string "DANIEL" 

15 would match the trigrams "xxD", "xDA", "DAN", "ANI", 
"NIE", "IEL" , "ELx" and "Lxx", where "x" is the special 
initial/final character. 

In a preferred embodiment, string matching, word 
matching and character matching are assigned weights, and 

20 the evaluation 316 of the text string match may be deter- 
mined by a weighted sum of the evaluations 316 for each 
type of match. In a preferred embodiment, each word is 
assigned equal weight within word matching and each tri- 
gram is assigned equal weight within character matching. 

25 The evaluation 316 of matched attribute-value pairs 

303 may also be determined for other data types besides 
the numeric data type and the text string data type. In 
a preferred embodiment, the evaluation 316 may also be 
determined for matched attribute-value pairs 303 with a 

30 multiple-choice data type. For example, for a multiple- 
choice data type in which the choices are RED, ORANGE, 
YELLOW, GREEN, BLUE, and VIOLET, the evaluation 316 of 
matching between RED and ORANGE might be 0.8, while the 
evaluation 316 of matching between RED and YELLOW might be 

35 0.4, and the evaluation 316 of matching between RED and 
GREEN might be zero. 
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Figure 5 shows a block diagram of a case-based rea- 
soning system 101 implemented within a rule-based reason- 
ing system. 

In a preferred embodiment, the inference engine 111 
5 for the case-based reasoning system 101 may be implemented 
within a rule-based reasoning system 501, such as the ART- 
IM rule-based reasoning system, manufactured by Inference 
Corporation of El Segundo, California. In the rule-based 
reasoning system 501, rules 103 may be matched against 

10 software objects 112, including a set of facts 502, cases 
105 and the case template 312, and may perform procedural 
actions on them. Software objects 112 may comprise data 
elements and relations to other software objects 112, as 
is well known in the art. Object-oriented systems are 

15 more fully described in "Object-Oriented Design With 
Applications" by Grady Brooch, published by Benjamin/ 
Cummings Publishing, Redwood City, California (1991) , 
hereby incorporated by reference as if fully set forth 
herein . 

20 In a preferred embodiment, cases 105 may be imple- 

mented as software objects 112, such as a "schema" in ART- 
IM. Each case 105 may comprise its attribute-value pairs 
303 and its relations to other software objects 112. For 
example, parameters of some problem 311 may be attributes 

25 301 of some case 105. Moreover, the prescribed action 309 
for the case 105 may be the ACTION attribute 301 or some 
other attribute 301. Its value 302 may be a text string 
describing the action 309, or may be another type of soft- 
ware object 112 to which the inference engine 111 may 

30 apply rules 103 or procedural structures 117. 

The inference engine 111 may be coupled to the data 
base 106 by means of a data interface 503. In a preferred 
embodiment, the data interface 503 may maintain the map- 
ping 114 between the data records 108 of the data base 106 

35 and the representative objects 115 representing those data 
records 108. The data interface 503 may comprise proce- 
dural structures 117 for defining the format of the data 
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records 108 in the secondary memory 109, for allocating 
and deallocating memory in the processor 110 to record 
representative objects 115, and for defining the format of 
the mapping 114 between the data records 108 and represen- 
5 tative objects 115. 

For example, the data interface 503 may define data 
records 108 to comprise a sequence of bytes indicating a 
numeric data type, allocate memory in the processor 110 
for a software object 112 with a numeric data type, and 

10 map the data records 108 to that software object 112. 
With the data interface 503, the inference engine 111 may 
operate on that software object 112 as if it were immedi- 
ately available to the processor 110, rather than in the 
secondary memory 109. 

15 A preferred data interface 503 is more fully 

described in "ART-IM Reference Manual", available from 
Inference Corporation of El Segundo, California, and 
hereby incorporated by reference as if fully set forth 
herein. 

20 The inference engine 111 may also be coupled to the 

case base 104 by means of the data interface 503. Cases 
105 may be recorded in the secondary memory 109, and may 
be mapped to the memory in the processor 110 so the infer- 
ence engine 111 may manipulate them as software objects 

25 112. In a preferred embodiment, the data interface 503 
may compile a case index 504 from the case base 104, which 
may comprise one or more signature files 3 07 (as in figure 
3A) or hash tables 320 (as in figure 3B) . The case index 
504 may also be partly or fully recorded in the secondary 

3 0 memory 109 with the case base 104, and may be moved from 
one processor 110 to another, with or without the case 
base 104 . 

The inference engine 111 may perform a flow diagram 
with the data interface 503 like that disclosed with fig- 
35 ure 2. Facts about the problem 311 may be gleaned from 
the user 119 by means of the user interface 118 and 
recorded in the case template 312. The case template 312 
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may be matched against the case base 104 using the case 
index 504 with a feature-matching procedure 505 like that 
disclosed with figure 3A or 3B. Some number of cases 105 
may be recorded in the match table 314 by the feature- 
5 matching procedure 505, of which one may be the "best" 
case 204. As the inference engine 111 is implemented 
within the rule-based reasoning system 501, it may also 
apply rules 103 or procedural structures 117 to the case 
template 312 before matching, and to the matched cases 105 

10 after matching. 

In a preferred embodiment, the inference engine 111 
may add new cases 105 to the case base 104 when it deter- 
mines that they are needed. In the case-matching step 202 
or in the best-case step 203, the inference engine 111 may 

15 determine that there is no case 105 which is a good match 
for the case template 312. The inference engine 111 may 
create a new case 105 which partly or fully copies the 
case template 312, and may ask the user 119 (by means of 
the user interface 118) what the prescribed acrtion 3 09 for 

20 the case 105 should be. The inference engine 111 may add 
the new case 105 to the case base 104 and proceed to 
another problem 311 with an augmented case base 104. 

The inference engine 111 may also add new cases 105 
to the case base 104 without asking the user 119. When 

25 the inference engine 111 determines that there is no case 
105 which is a good match for the case template 312, it 
may invoke a rule 103 or a procedural structure 117 which 
creates a new case 105, which may partly or fully copy the 
case template 312. Since cases 105 are software objects 

30 112, a rule 103 may create a new case 105 and may assign 
a value 302 to the ACTION attribute 301 (as well as to 
other attributes 301) . 

In the note-action step 2 05, the inference engine 111 
may also determine that the case template 312 matches one 

35 or more cases 105 in the case base 104, but that the 
actions 309 prescribed by those cases 105 are incorrect. 
For example, the inference engine 111 may invoke rules 103 
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which check that the action 309 for the "best" case 204 is 
inconsistent with known facts 502, or the inference engine 
111 may maintain a subsequent history with the case 105 
and invoke rules 103 which determine if the action 309 
5 taken was successful, or the inference engine 111 may ask 
the user 119 at a later time if the action 309 taken was 
successful. 

The inference engine 111 may also remove cases 105 
from the case base 104 when it determines that those cases 

10 105 are poor or obsolete. In the note-action step 205, 
should the inference engine 111 determine that the action 
309 for the "best" case 204 is incorrect (e.g., by tech- 
niques noted herein) it may determine that the case 105 is 
no longer a good exemplar case 105 and may remove it from 

15 the case base 104. The inference engine 111 may proceed 
to the next problem 311 with a corrected case base 104. 

Figure 6 shows an example case-based reasoning system 
101 for providing user help on call-in complaints. 

One application field for case-based reasoning sys- 

2 0 terns 101 may comprise an automated "help desk" application 
601 for assisting a company's customer service personnel 
in giving advice to customers who call in with problems or 
questions. Automated help desk systems typically comprise 
a telephone call management system, a problem tracking 

25 database, and on-line documentation. Using case-based 
reasoning to identify similar problems and record advice 
for such problems would provide for a quicker and more 
reliable automated help desk system. 

In the automated help desk application 601, the user 

30 119 may comprise a customer service representative 602, 
who may typically be receiving a telephone call 603 from 
a customer 604. A set of customer problems 605 and advice 
to respond with may be stored as cases 105. Attributes 
301 of the cases 105 may include features of the customer 

35 problems 605. In addition to matching on the description 
606, the application 601 may ask questions and obtain 
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answers which allow it to determine which case 105 is the 
"best" case 204, and thus to provide appropriate advice. 

The automated "help desk" application 601 may perform 
a flow diagram like that disclosed with figure 2, with 
5 some modifications. In the description step 201, the 
application 601 may retrieve a text string description 606 
of the customer problem 605. In the case-matching step 
202, the application 601 may attempt to match the customer 
problem 605 to one or more cases 105 in the case base 104 

10 using just the description 606 of the customer problem 
605. If the match quality 315 of the case 105 which are 
matched is high, the application 601 may perform the best- 
case step 203 and following steps. The action 309 which 
the application 601 performs is to provide an advice mes- 

15 sage 607 to the customer service representative 602, who 
may then provide advice to the customer 604. 

However, it may occur that cases 105 which are 
matched all have low match quality 315. The application 
601 may collect a set of question-answer pairs 608 from 

20 the cases 105 which are matched. The application 601 may 
present a set of questions 609 from the question-answer 
pairs 608 to the customer service representative 602, who 
would provide a set of answers 610 to the application 601 
(typically by asking the customer 604) . The application 

25 601 may perform the case-matching step 202 with the 
question-answer pairs 608 as additional attribute-value 
pairs 303 to match. In a preferred embodiment, weights 
may be assigned to the description 606 and to each 
question-answer pair 608. 

30 If no "best" case 204 can be matched even with the 

question-answer pairs 608, the application 601 may create 
a new case 105 which copies the case template 312 and ask 
the customer service representative 602 for the advice 
message 607 to include with the case 105. In a preferred 

35 embodiment, the application 601 may be operated with few 
cases 105 or even no cases 105 to start with, since the 
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application 601 may create new cases 105 when there is no 
"best" case 204 in the case base 104. 

In a preferred embodiment, the application 601 may 
communicate with the user 119 by means of a set of display 
5 panels 611. Each panel 611 may comprise a display window 
which may present information to, and/or request informa- 
tion from, the user 119, typically with a form to be com- 
pleted. Each panel 611 may comprise data fields which the 
user 119 may read or write, plus command icons which the 

10 user 119 may indicate (with a pointing device such as a 
mouse) to tell the application 601 to perform those com- 
mands. In a preferred embodiment, the application 601 may 
present the panel 611 which is appropriate to the case- 
based reasoning step it is performing, or the user 119 may 

15 direct the application 601 to display particular panels 
611. 

In a preferred embodiment, the panels 611 may also 
present and/or request graphical information, such as an 
electronic circuit diagram or an exploded view of an auto- 

20 mobile. The panels 611 may also present information in 
hypertext format, as is well known in the art. Thus, the 
user 119 may request more information about a particular 
segment of text by identifying that segment (e.g., with a 
pointing device such as a mouse) and requesting that the 

25 application 60.1 display more information. 

A call tracking panel 612 may present and/ or request 
information relating to customers 604 who call and the 
telephone calls 603 they have made to the customer service 
representative 602. Thus, the user 119 may identify new 

30 customers 604 and new telephone calls 603 using the call 
tracking panel 612. Figure 6A shows the call tracking 
panel 612 in detail. 

A case search panel 613 may present and/or request 
information relating to the customer problem 605. Thus, 

35 the user 119 may define the case template 312 using the 
case search panel 613 . The customer service representa- 
tive 602 may also answer questions by means of the case 
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search panel 613. Figure 6B shows the case search panel 
613 in detail. 

A case panel 614 may present and/or request informa- 
tion relating to new cases 105. Thus, the user 119 may 
5 define new cases 105 using the case panel 614. The case 
panel 614 may typically be used by users 119 who are 
experts on the company's product, and the customer service 
representative 602 may not need to use the case panel 614 
at all. Figure 6C shows the case panel 614 in detail. 

10 A question panel 615 may present and/or request 

information relating to question-answer pairs 608. Thus, 
the user 119 may create new questions 609 and record pos- 
sible answers 610 for cases 105, using the question panel 
615. The question panel 615 may typically be used by 

15 users 119 who are experts on the company's product, and 
the customer service representative 602 may not need to 
use the question panel 615 at all. Figure 6D shows the 
question panel 615 in detail. 

An action panel 616 may present and/or request infor- 

20 mation relating to actions 309. Thus, the user 119 may 
create new actions 309 or alter old actions 309 using the 
action panel 616. The action panel 616 may typically be 
used by users 119 who are experts on the company's pro- 
duct, and the customer service representative 602 may not 

25 need to use the action panel 616 at all. Figure 6E shows 
the action panel 616 in detail. 

A preferred example case-based reasoning system 101 
for providing user help on call-in complaints is more 
fully described in "CBR Express User's Guide", available 

30 from Inference Corporation of El Segundo, California, and 
hereby incorporated by reference as if fully set forth 
herein . 

Alternative Embodiments 

While preferred embodiments are disclosed herein, 
35 many variations are possible which remain within the con- 
cept and scope of the invention, and these variations 
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would become clear to one of ordinary skill in the art 
after perusal of the specification, drawings and claims 
herein. 
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Claims 

1. A case-based reasoning system, comprising 

a rule base having a plurality of inferential 

rules ; 

5 a case base having a plurality of exemplar 

cases; 

a data base having a plurality of data items; 

and 

an inference engine capable of performing case- 
10 based reasoning steps on said cases, retrieving a set of 
matching cases for a problem template, and performing 
rule-based reasoning steps on said set of matching cases. 

2. A case-based reasoning system, comprising 

a rule base having a plurality of inferential 

15 rules ; 

a case base having a plurality of exemplar 

cases ; 

a data base having a plurality of data items; 

and 

20 an inference engine capable of performing case- 

based reasoning steps on said cases, and capable of per- 
forming rule-based reasoning steps on said data items 
using said rules in a unified automated reasoning system; 

wherein said inference engine comprises means 

25 for matching a problem template having a set of facts to 
said case base; and means for applying said rules to said 
cases, said data items and said facts. 

3. A system as in claim 2, wherein said inference 
engine comprises means for selecting a case which is a 

3 0 best match for said problem template; and means for 
selecting an action which differs substantially from an 
action prescribed for that case. 

4. A system as in claim 2, wherein said inference 
engine comprises means for adding a new case to said case 
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base in response to a set of problems which said system 
encounters . 

5. A system as in claim 4, wherein said new case 
comprises at least one attribute-value pair which is 

5 copied from an unmatched problem template. 

6. A system as in claim 4, wherein said new case 
comprises at least one attribute-value pair which is input 
from a human operator. 

7 . A system as in claim 4 , wherein said inference 
10 engine comprises means for adding a new case to said case 

base, wherein said new case matches an unmatched problem 
template and wherein an action for said new case is exter- 
nally input. 

8. A system as in claim 2, wherein said inference 
15 engine comprises means for removing an old case from said 

case base in response to a set of problems which said sys- 
tem encounters. 

9. A system as in claim 2, comprising a case base 
which has been constructed substantially by adding new 

20 cases in response to a set of unmatched problem templates. 

10. A system as in claim 2, comprising a case base 
which has been constructed substantially by adding new 
cases in response to external input. 

11. A system as in claim 2, comprising a case base 
25 which has been constructed substantially by adding new 

cases and removing old cases from a predetermined case 
base, in response to a set of problems which said system 
encounters . 
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12. A system as in claim 2, wherein said inference 
engine comprises a set of software objects which corres- 
pond to said cases and said data items. 

13. A system as in claim 12, wherein said inference 
5 engine comprises a data interface which is capable of 

maintaining a case index. 

14. A system as in claim 12, wherein said inference 
engine comprises a case index transported from a second 
case-based reasoning system. 

10 15. A system as in claim 12, wherein said inference 

engine comprises a data interface which is capable of 
maintaining a mapping between said software objects and 
said cases, and capable of maintaining a mapping between 
said software objects and said data items. 

!5 16. A system as in claim 12, wherein said inference 

engine comprises a data interface which is responsive to 
a match table of said cases. 

17. A system as in claim 2, wherein said inference 
engine comprises means for constructing said problem 

20 template. 

18. A system as in claim 17, wherein said means for 
constructing said problem template comprises means for 
soliciting information from a human operator. 

19 . A system as in claim 17 , wherein said means for 
25 constructing said problem template comprises means for 

engaging a human operator in a question-answer dialogue. 

20. A system as in claim 2, wherein said inference 
engine comprises means for matching said problem template 
against said case base. 
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21. A system as in claim 20, wherein said means for 
matching comprises a case index. 

22. A system as in claim 20, wherein said means for 
matching comprises a match table. 

5 23. A system as in claim 2, comprising means for 

performing a method of matching a problem template to a 
case base, said method comprising the steps of 

first generating a set of signature bits in 
response to at least one attribute-value pair for each 
10 case in said case base; 

second generating a set of signatures, one for 
each said case, in response to said set of signature bits; 

recording a signature file having at least one 
mapping from said set of signatures to said cases; 
15 third generating a set of test bits for said 

problem template; and 

searching said signature file in response to 
said test bits. 

24. A system as in claim 23, wherein said first 
20 generating step comprises applying at least one signature 

function to said at least one attribute-value pair. 

25. A system as in claim 23, wherein said third 
generating step comprises applying at least one signature 
function to at least one attribute-value pair for said 

25 problem template. 

26. A system as in claim 23, wherein said at least 
one attribute-value pair comprises an attribute with a 
data type selected from the group: numeric, boolean, list 
structure, array structure, text string, multiple-choice. 

30 27. A system as in claim 23, wherein said third 

generating step is responsive to at least one numeric 
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range for an attribute-value pair with a numeric data 
type. 

28. A system as in claim 23, wherein said third 
generating step generates a first test bit in response to 

5 whether a value in said attribute-value pair falls within 
a first range and generates a second test bit in response 
to whether said value falls within a second range. 

29. A system as in claim 23, wherein said third gen- 
erating step is responsive to string matching, word match- 

10 ing, or character matching, for an attribute-value pair 
with a text string data type. 

30. A system as in claim 23, wherein said third gen- 
erating step generates a set of test bits in response to 
at least one substring of a value in an attribute-value 

15 pair with a text string data type. 

31. A system as in claim 30, wherein said at least 
one substring comprises a set of words found in a said 
value. 

32. A system as in claim 30, wherein said at least 
20 one substring comprises a set of trigrams found in said 

value . 

33. A system as in claim 30, wherein said at least 
one substring comprises at least one substring of said 
value after a predetermined set of characters has been 

25 removed from said value. 

34. A system as in claim 23, wherein a set of cases 
which are matched are recorded in a match table. 

35. A system as in claim 23, wherein a set of cases 
which are matched are evaluated for quality of match. 
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36. A system as in claim 23, wherein said third 
generating step is responsive to a plurality of values in 
an attribute-value pair with a multiple-choice data type. 

37. A system as in claim 2, comprising means for 
5 performing a method of matching a problem template to a 

case base, said method comprising the steps of 

first generating a case location in a hash table 

in response to at least one attribute-value pair for each 

case in said case base; 
10 . recording at least one pointer to a case in each 

one of said case locations; 

second generating at least one problem location 

in said hash table in response to at least one problem 

attribute-value pair; and 
15 selecting among a set of cases pointed to by 

said pointers found in said hash table at said at least 

one problem location. 

38. A system as in claim 37, wherein said first 
generating step comprises applying a hash function to said 

20 at least one attribute-value pair. 

39. A system as in claim 37, wherein said second 
generating step comprises applying a hash function to said 
at least one problem attribute-value pair. 

40. A case-based reasoning system, comprising 

25 a rule base having a plurality of inferential 

rules; 

a case base having a plurality of exemplar 

cases ; 

a data base having a plurality of data items; 

30 and 

an inference engine capable of performing case- 
based reasoning steps on said cases and retrieving a set 
of matching cases for a problem template, wherein said 
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inference engine is capable of adding new cases to said 
case base in response to a set of differences between said 
set of matching cases and said problem template. 

41. A case-based reasoning system, comprising 

5 a case base having a plurality of exemplar 

cases ; 

an inference engine capable of performing case- 
based reasoning steps on said cases and retrieving a set 
of matching cases for a problem template; 
10 means for soliciting external advice about 

treatment of said problem template in response to a set of 
differences between said set of matching cases and said 
problem template; and 

means for altering said case base in response to 
15 said external advice. 

42. A system as in claim 41, wherein said system is 
initiated with a case base which is known not to span a 
set of problem templates which the system is intended to 
handle. 

20 43. An automated help-desk system, comprising 

a case-based reasoning system having a plurality 
of exemplar cases in a case base; 

means for communicating between a human operator 
and a plurality of customers; and 

25 an inference engine capable of performing case- 

based reasoning steps on said cases, providing information 
to said human operator on a set of matching cases for a 
problem template, and soliciting advice from said human 
operator on said set of matching cases. 

30 44. A method of case-based reasoning, comprising the 

steps of 

determining a problem template having a set. of 

facts ; 
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performing rule-based reasoning steps on said 

facts ; 

retrieving a set of matching cases for said 
problem template; 
5 retrieving a prescribed action from one of said 

set of matching cases; and 

performing said prescribed action. 

45. A method of case-based reasoning, comprising the 
steps of 

10 determining a problem template having a set of 

facts; 

retrieving a set of matching cases for said 
problem template; 

performing rule-based reasoning steps on said 
15 set of matching cases; 

retrieving a prescribed action from one of said 
set of matching cases; and 

performing said prescribed action.- 

46. A method of case-based reasoning, comprising the 
20 steps of 

determining a problem template having a set of 

facts ; 

retrieving a set of matching cases for said 
problem template; 
25 soliciting external advice to determine a best 

case in said set of matching cases; 

retrieving a prescribed action from said best 

case; and 

performing said prescribed action. 

30 47. A method of case-based reasoning, comprising the 

steps of 

determining a problem template having a set of 

facts ; 
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retrieving a set of matching cases for said 
problem template; 

retrieving a prescribed action from one of said 
set of matching cases; 
5 performing rule-based reasoning steps on said 

prescribed action; and 

performing said prescribed action. 

48. A method of case-based reasoning, comprising the 
steps of 

10 determining a problem template having a set of 

facts ; 

retrieving a set of matching cases for said 
problem template; 

altering said case base in response to said set 
15 of matching cases; 

retrieving a prescribed action from one of said 
set of matching cases; and 

performing said prescribed action. 

49. A method as in claim 48, wherein said step of 
20 altering comprises either adding a new case to said case 

base or removing an old case from said case base. 



50. A method of matching a problem template to a 
case base, comprising the steps of 

first generating a set of signature bits in 
25 response to at least one attribute-value pair for each 
case in said case base; 

second generating a set of signatures, one for 
each said case, in response to said set of signature bits; 

recording a signature file having at least one 
30 mapping from said set of signatures to said cases; 

third generating a set of test bits for said 
problem template; and 

searching said signature file in response to 
said test bits. 
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51. A method of matching a problem template to a 
case base, comprising the steps of 

first generating a case location in a hash table 
in response to at least one attribute-value pair for each 
5 case in said case base; 

recording at least one pointer to a case in each 
one of said case locations; 

second generating at least one problem location 
in said hash table in response to at least one problem 
10 attribute-value pair; and 

selecting among a set of cases pointed to by 
said pointers found in said hash table at said at least 
one problem location. 
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